Web Survey Bibliography
Title Telephone versus Face-to-Face Interviewing: Mode Effects on Data Quality and Likely Causes. Report on Phase II of the ESS-Gallup Mixed Mode Methodology Project
Author Jaeckle, A., Lynn, P., Roberts, C.,
Source ISER Working Paper Series
Year 2006
Access date 22.04.2014
Full text
Abstract
This report presents findings from an experimental study carried out in the context of the European Social Survey, to assess the impact a change in data collection mode from the current face-to-face interviewing to telephone might have on data quality and to study the likely causes of any observed mode effects. Evidence from previous studies suggests which differences in response can be expected between telephone and face-to-face interviewing and also suggests likely causes of such differences. Previous empirical studies are, however, often limited in their ability to isolate different causes. The experimental design enabled us to distinguish mode effects caused by differences in the type of question stimulus used in each mode (audio vs. visual) and mode effects caused by the presence or absence of the interviewer. The design included three comparison groups (two interviewed face-to-face (one with showcards, one without) and the third by telephone). We found evidence of effects caused by the presence of the interviewer, but few stimulus effects. We tested a number of hypotheses about the likely causes of mode effects on response, focusing on three forms of satisficing and social desirability bias. We found no evidence that using showcards influenced response quality, either positively or negatively. Unlike previous studies, we found no support for the hypothesis that telephone respondents were more likely to satisfice. However, consistent with our expectations, we did find telephone respondents were more likely to give socially desirable responses across a range of indicators.
Access/Direct link
Homepage (abstract) / (full text)
Year of publication2006
Bibliographic typeReports, seminars
Web survey bibliography - Reports, seminars (231)
- Libraries nationwide receiving ALA-APA Library Salary Survey Invitation; 2010; Grady, J.
- Ethical principles of psychologists and code of conduct; 2010
- Ekos' observation of MRIA study - Canadian online panels: similar or different?; 2010
- Demographics of mechanical Turk. Ceder working papers; 2010; Ipeirotis, P. G.
- Broadband adoption and use in America; 2010; Horrigan, J.
- Continuity and Innovation in the Design of Understanding Society: the UK Household Longitudinal Study...; 2010; Laurie, H.
- Weighting Strategy for Understanding Society; 2010; Lynn, P., Kaminska, O.
- Understanding Society Innovation Panel Wave 2: Results from Methodological Experiments ; 2010; Burton, J., Laurie, H., Uhrig, S. C. N.
- Codebook and explanatory note on the WageIndicator dataset ; 2010; Tijdens, K., van Zijl, S., Hughie-Williams, M., van Klaveren, M., Steinmetz, S.
- Online Survey Research in the Work-Family Field: Basic Concepts and Definitions; 2010; Lambert, A. D.
- Choosing Between Telephone and Online for Survey Data Collection ; 2010; Baker, R. P.
- Using KnowledgePanel® to Improve the Sample Representativeness and Accuracy of Opt-in Panel Data...; 2010; Dennis, J. M., Peugh, J., Graham, P.
- AAPOR Report on Online Panels; 2010; P., Blumberg, S. J., Brick, J. M., Rivers, D. et. al.Baker, R. P.
- A comparison of surveys using different modes of data collection; 2010; Revilla, M., Saris, W. E.
- User’s Guide to the Advance Release of the 2008-2009 ANES Panel Study ; 2009; DeBell, M.; Krosnick, J. A.; Lupia, A.; Roberts, C.
- Start of the LISS panel: Sample and recruitment of a probability-based Internet panel ; 2009; Scherpenzeel, A.
- MarketTools TrueSample; 2009
- ISO 26362 Access panels in market, opinion, and social research-Vocabulary and service requirements; 2009
- Exploring mode effects in a panel survey of new businesses; 2009; Santos, B., DesRoches, D.
- comScore Media Metrix U.S. Methodlogy. An ARF research review; 2009; Cook, W. A., Pettit, R.
- Association collaborative effort releases online research definitions, expands membership; 2009
- Sample Design for Understanding Society ; 2009; Lynn, P.
- The rise of survey sampling; 2009; Bethlehem, J.
- Employment Tribunal web survey: Results of an online survey 19 March - 2 April 2009; 2009; Anonymous
- Representativeness of Mobile Internet Surveys-A comparative study of CAMI vs. CATI - GOR 2009; 2009; Maier, U., Neubarth, W., Grosser, A., Hombach, A.
- Are Mode Preferences Real?; 2009; Millar, M. M., O'Neill, A. C., Dillman, D. A.
- Platforms for data quality progress: The client's guide to rapid improvement of online research; 2008
- Is the digital divide still closing? New evidence points to skewed online results absent non-Internet...; 2008; Callegaro, M., Wells, T.
- Introducing Visual Methods ; 2008; Prosser, J., Loxley, A.
- Personal data of 600,000 on lost laptop; 2008; Evans, Mi.
- Online panel management practices that minimize satisficing behavior; 2008; Weber, S.
- History of the browser user agent string; 2008; Andersen, A.
- Foundation of quality project overview; 2008
- Effects of using a grid versus a sequential form of the ACS basic demographic data; 2008; Chesnut, J.
- Does Gender Influence Online Survey Participation? A Record-Linkage Analysis of University Faculty Online...; 2008; Smith, W. G.
- Non-Response in the Panel Study of Belgian Households (1992-2002): An Output and Process Evaluation; 2007; De Keulenaer, F.
- Sample bias, weights and efficiency of weights in a continuous web voluntary survey; 2007; de Pedraza, P., Tijdens, K., de Bustillo, R.
- Mixing modes of data collection in surveys: A methodological review; 2007; Roberts, C.
- The impact of cookie deletion on the accuracy of site-server and ad-server metrics: An empirical comScore...; 2007; Abraham, Ma., Meierhoefer, C., Lipsman, A.
- The case for publishing (some) online polls; 2007; Taylor, H.
- Response option ordering: Reconciliating meanings conveyed by rating scale position and label. Unpublished...; 2007; Garland, P., Krosnick, J. A.
- More honest answers to surveys? A Study of data collection mode effects; 2007; Dennis, J. M., Li, R. J.
- ICC/ESOMAR International code on market and social research; 2007
- Global market research 2007; 2007
- Can I use a panel? Panel conditioning and attrition bias in panel surveys; 2007; Das, M., Toepoel, V., van Soest, A.
- Guidelines for Designing Questionnaires for Administration in Different Modes; 2007; Martin, E., Hunter, J. E., DeMaio, T., Hill, Jo., Reiser, C., Gerber, E., Styles, K., Dillman, D. A.
- Email Surveys in Educational Research: Ethical and Net-Cultural Concerns; 2007; Nguyen, C. H.
- Telephone versus Face-to-Face Interviewing: Mode Effects on Data Quality and Likely Causes. Report...; 2006; Jaeckle, A., Lynn, P., Roberts, C.,
- Essential Steps for Web Surveys: A Guide to Designing, Administering and Utilizing Web Surveys for University...; 2006; Cheskis-Gold, R., Loescher, R., Shepard-Rabadam, E., Carroll, B.
- Measuring task-specific perceptions of the world wide web ; 2006; Page-Thomas, K.